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SYSTEM AND METHOD FOR THE MEASUREMENT OF OPTICAL DISTORTIONS 

TECHNICAL FIELD OF THE INVENTION 

{00011 The present invention relates generally to the 
measurement of optical distortions, and more particularly, a 
5 system and method to rapidly measure the optical distortions of 

an aircraft canopy. 
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BACKGROUND OF THE INVENTION 

[0002] Aircraft canopies protect the pilot from direct exposure 
to the flight environment while ideally providing the largest 
possible unobstructed view from the cockpit. In new fighter 
5 aircraft, the exterior shapes of the canopy typically include 

compound curvatures. These compound shapes are imposed by 
aerodynamic, structural, bird strike safety and electromagnetic 
signature requirements. In order to satisfy structural and bird 
strike safety requirements, plastic-based canopies have become 

10 quite thick to withstand these stresses. These thick canopies 

introduce strong refractive optical power and distortion into the 
view of the outside world. These optical distortions vary with 
target azimuth, elevation, and the pilot's eye (x, y, z) 
position. The distortions thus also vary between the left and 

15 right eye at any given viewing direction. 

[0003] Canopy optical distortions interfere with the accuracy 
of visual cueing, and must be measured and compensated for in 
positioning of heads-up display (HUD) or helmet mounted display 
(HMD) symbology. Canopy manufacturing processes introduce 

20 additional optical distortions having even higher spatial 

frequencies than the basic canopy refractive properties. 
Unfortunately, these additional manufacturing distortions are 
unique to each canopy, with no two canopies ever exhibiting 
identical optical distortions. This situation is made worse as 
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even more complex canopies are planned for new aircraft. These 
canopies are anticipated to have unique optical distortion 
characteristics. These unique optical characteristics 
necessitate the design, manufacture and use of mapping fixtures 
5 to individually measure canopy optical distortions over the 

specified field of regard (FOR) and region around design eye for 
each canopy produced. These variable optical distortions further 
necessitate algorithms that dynamically position HUD or HMD 
symbology based on each canopy' s set of optical unique 
10 distortions and the pilot's moving head position within the 3-D 

pilot eye volume (PEV) , 

[0004] Previous mapper solutions sequentially project 
collimated light from a single small target at a series of 
scripted azimuth and elevation angles through the test canopy and 

15 into a camera lens. The camera is located at or near the pilot's 

design eye location. The camera forms an image of the projected 
target. Post-processing software calculates the (x, y) position 
of the target image and the corresponding azimuth/elevation 
angular deviation. This method gives very good accuracy and 

20 repeatability, on the order of 0.1-0.2 milliradians or better, at 

each particular measurement angle and eye position. 
[0005] The principle disadvantage of this method is that only a 
single angular deviation value is measured at a time. The canopy 
is positioned on the fixture to place the imaging camera at one 
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specific eye position, and the optical deviations of a scripted 
array of azimuth and elevation angles are sequentially measured 
at that eye point. The canopy must then be re-positioned on the 
fixture to the next eye position, and the same script of azimuth 
5 and elevation angle measurements repeated. Typically a minimum 

of five eye positions are measured, one at design eye, one above, 
one below, and two more at left and right of design eye. Newer 
fighter aircraft employing wide field-of -regard HMD's require 
many more eye positions over the 3-D PEV to be measured as well. 

10 The final reported optical deviation and symbology position 

compensation at any given azimuth and elevation is but a single, 
fixed weighted least squares composite average of the overlapping 
deviations from the different eye positions. Symbology positions 
projected on HUD' s or HMD's cannot change with head (x, y, z) 

15 position, even though canopy optical distortions are continuously 

changing with eye position. Thus, projected symbology does not 
overlay exterior imagery over the complete viewing solid angle 
and PEV to the accuracies required by the new weapons systems. 
[0006] Furthermore, sequential measurements can take an hour or 

20 more just for the relatively small angular solid angle of 

measurements needed for the HUD, and 8-10 hours or more for 
larger solid angles such as required for F-16 HMD's. These long 
measurement times dictate relatively sparse optical deviation 
data sampling. Sparse sampling reduces the accuracy of post- 
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measurement curve fitting and symbology placement. New systems 
such as those employed by the F-35 aircraft require that 
deviation measurements be taken over a very large field of regard 
(FOR) for a tactical fighter aircraft, and over a very large 3-D 
5 PEV. The need for large solid angle coverage and larger 3-D PEV, 

combined with increased accuracy requirements on symbology 
placement, essentially renders previous sequential, discrete 
measurement methods totally impractical. No previous or present 
optical deviation mapping fixtures have the means to resolve this 
10 deficiency. 

[0007] Therefore a need exists for a means to rapidly measure 
optical deviations created by an aircraft canopy through many 
possible 3-D locations of a pilot's eye within the canopy. 
Additionally, a need exists for a system and method capable of 
15 taking measured optical deviations and dynamically applying 

corrections to these deviations to dynamically align symbology 
within an HMD field of view to exterior images. 
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SUMMARY OF THE INVENTION 

[0008] The present invention relates generally to the 
measurement of optical distortions. More particularly^ the 
present invention provides a system and method to rapidly measure 
5 the optical distortions of an aircraft canopy that substantially 

addresses these needs as well as others. 

[00091 One embodiment provides a method with which to determine 
optical deviations caused by an aircraft canopy. This involves 
generating a collimated beam of light of sufficient aperture to 

10 fully illuminate the 3-D PEV with some margin. The collimated 

beam of light then passes through an optical mask (termed a 
Hartmann mask) to produce an array pattern of sub-apertures, each 
projecting separate smaller collimated beams of light. The 
pattern of sub-aperture collimated beams of light is directed 

15 onto an imaging screen to produce multiple sub-aperture images, 

wherein the images are digitally imaged and are then stored in 
memory. When the canopy is not in the path of the patterned 
collimated beams of light, an undistorted image results and is 
stored in memory. When the canopy is in the path of the 

20 patterned collimated beams of light, a distorted image results as 

the aircraft canopy distorts the individual patterned collimated 
beams of light. The distorted image and is stored in memory. 
The distorted image .is compared to the undistorted image to 
determine the optical distortions caused by the aircraft canopy. 
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[0010] The collimated beam of light is generated external to 
the aircraft canopy, masked with the Hartmann sub-aperture mask, 
and imaging screens and cameras located within the aircraft 
canopy in a first embodiment. A second embodiment generates the 
5 Hartmann sub-aperture collimated beams of light within the 

aircraft canopy and the imaging screens and cameras are located 
outside the aircraft canopy. Both embodiments allow the 
collimated beams of light to be directed to or from the pilot's 
eye centroid over the full 3-D PEV from varying combinations of 

10 elevation and azimuth angles. 

[0011] Another embodiment provides an apparatus to measure 
optical deviations caused by an aircraft canopy. In this 
apparatus, a light source generates a beam of light. A 
collimator lens or mirror, optically coupled to the light source, 

15 then collimates the beam of light. A Hartmann mask patterns the 

collimated beam of light into smaller sub-apertures of collimated 
light, which are directed onto an imaging screen. The patterned 
collimated beams of light produce images, which are recorded to 
computer memory with analog or digital imaging cameras. An 

20 undistorted image results when the aircraft canopy is not placed 

in a path of the patterned collimated beam of light. However, a 
distorted image results when the aircraft canopy is placed in a 
path of the patterned collimated beams of light and distorts the 
patterned collimated beam of light. A processing unit compares 
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the distorted image to the undistorted image to determine the 
optical distortions caused by the aircraft canopy • One 
embodiment locates the light source^ collimator, and Hartmann 
mask outside the aircraft canopy and the imaging screen within 
the aircraft canopy. Another embodiment reverses this 
relationship. 

[0012] Yet another embodiment provides an apparatus to 
determine optical deviations caused by an aircraft canopy. This 
embodiment places a contrasting optical pattern external to the 
aircraft canopy. A camera located within the pilot's eye 
centroid captures both an undistorted image when the aircraft 
canopy is not placed between the camera and the contrasting 
optical pattern, and a distorted image when the aircraft canopy 
is placed between the camera and the contrasting optical pattern. 
A processing unit receives and stores the undistorted image and 
distorted image in memory operably coupled to the processing 
unit. The processing unit also compares the distorted image to 
the undistorted image to determine the optical distortions caused 
by the aircraft canopy. 

[0013] The wavef ront-error determination provided by the 
present invention greatly improves the measurement accuracy and 
speed of canopy optical deviation data. Further, proven 
wavefront error reconstruction algorithms and associated software 
can accurately reconstruct canopy angular deviations at any 
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azimuth and elevation for any continuously varying point within 
the PEV. This enables greatly improved visual cueing and 
alignment between computer-generated symbology and real world 
images external to the aircraft that also dynamically accounts 
5 for the optical distortions of the aircraft canopy. 



9 



ATTORNEY DOCKET NO. 
1017.P073US 



PATENT APPLICATION 



BRIEF DESCRIPTION OF THE DRAWINGS 

(00141 For a more complete understanding of the present 
invention and the advantages thereof, reference is now made to 
the following description taken in conjunction with the 
5 accompanying drawings in which like reference numerals indicate 

like features and wherein: 

[0015] FIGURES lA and IB depict an incoming optical wave front 
and the optical effect a canopy has on this wave front; 
[0016] FIGURES 2A and 2B provide Hartmann spot pattern images 
10 depicting the optical deviations caused by the canopy of FIGURES 

lA and IB; 

[0017] FIGURE 3 provides an optical model for a tilted 
cylindrical canopy of FIGURE IB; 

[0018] FIGURES 4A-4E provide Hartmann spot patterns for a 
15 cylindrical canopy where the distance from focus is varied; 

[0019] FIGURE 5 depicts one configuration used to determine 
optical deviations associated with the canopy in accordance with 
the present invention; 

[0020] FIGURE 6 provides a second embodiment used to determine 
20 optical deviations associated with the canopy in accordance with 

the present invention; 

[0021] FIGURE 7 is an example of direct image displacement 
determined in accordance with the present invention; 
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[0022] FIGURE 8A and 8B depict potential configurations set up 
to determine optical deviations of an aircraft canopy in 
accordance with embodiments of the present invention; 
[0023] FIGURES 9A and 9B depict a perfect wave front and a 
5 warped wave front distorted by an actual aircraft canopy, 

respectively; 

[0024] FIGURE 10 provides a system to determine the optical 
deviations that a canopy has on incoming light received from 
varying elevation and azimuth angles; 

10 [0025] FIGURE 11 provides a second embodiment of a system to 

determine the optical deviations of a canopy on incoming wave 
fronts from varying elevations and azimuth angles; 
[0026] FIGURE 12 is a logic flow diagram of a process to 
determine optical deviations of an aircraft canopy in accordance 

15 with one embodiment of the present invention; 

[0027] FIGURE 13 is a logic flow diagram of a process to 
determine optical distortions of an aircraft canopy in accordance 
with another embodiment of the present invention; and 
[0028] FIGURE 14 is a logic flow diagram of yet another process 

20 to determine optical distortions of an aircraft canopy in 

accordance with yet another embodiment of the present invention. 
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DETAILED DESCRIPTION OF THE INVENTION 

[0029] Preferred embodiments of the present invention are 
illustrated in the FIGURES, like numerals being used to refer to 
like and corresponding parts of the various drawings. 
5 [0030] The present invention provides a means for measuring 

canopy optical deviations accurately and over a large field of 
regard (FOR) and large PEV. Additionally, the present invention 
allows these measurements to be made in a rapid and massively 
parallel manner when compared to previous methods, as the 

10 wavefront errors over the entire PEV are measured and calculated 

with a single pair of camera images. These improvements in 
measurement speed and accuracy are coupled with algorithms that 
dynamically compensate for canopy optical distortion and HMD 
symbology placement as a function of head position. This results 

15 in improved visual cueing and alignment between computer 

generated symbology and exterior images. 

[0031] One embodiment provides a novel concept for canopy 
characterization and measurement. This concept directly measures 
transmitted wavefront error. An optical wavefront is defined as 
20 a continuous surface of constant optical phase at any instant in 

time. Light emitted, reflected or scattered from distant objects 
illuminates the entire aircraft, canopy, cockpit, pilot and 
immediate region around design eye with optical wavefronts. The 
portion of incident light transmitted through the canopy into the 
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cockpit illuminates the pilot with an optical wavefront distorted 
by the canopy's optical and refractive properties and 
manufacturing errors. The transmitted canopy wavefront error 
profile continuously varies with illumination azimuth and 
5 elevation angle, and fully illuminates the pilot's helmet, visor 

and face at each angle. Optical rays are 2-D gradients (surface 
normals) perpendicular to this transmitted wavefront profile at 
any given point on the wavefront profile. A distorted wavefront 
produces corresponding angular deviations of its surface normals. 

10 These angular deviations are viewed as optical distortion of the 

outside world and vary with wavefront (x, y, z) • Thus, a pilot 
may experience different optical deviations between the left and 
right eyes. These optical deviations further vary as the pilot's 
head is repositioned. 

15 [0032] The 3-D portion of the canopy transmitted wavefront 

error of interest for accuracy and HMD symbology placement may be 
referred to in this disclosure as the Pilot Eye Volume (PEV) . 
The total 3-D excursion range of pilot neck, head and eye motion 
sets the dimensions of the PEV, as well as the seat height 

20 setting and any additional imaging camera locations. The pilot's 

eye pupils or helmet camera pupils dynamically sample a very 
small portion of this total transmitted wavefront error. 
[0033] Existing wavefront error sensors have been developed to 
support high-energy atmospheric laser applications. Free-stream 
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atmospheric turbulence produces highly inhomogeneous air density 
distributions and corresponding optical wavefront errors due to 
changing local index of refraction along the laser beam's path. 
These density fluctuations vary rapidly in spatial distribution, 
5 frequency and strength, having bandwidths on the order of several 

hundred hertz. Compounded with these free stream propagation 
wavefront errors are those introduced by the local aerodynamic 
flowfields surrounding the beam director telescope. These 
flowfield wavefront errors have even higher bandwidths, ranging 

10 up to several kilohertz. Wavefront error sensing devices exist 

that can measure dynamic wavefront errors at speeds exceeding 10 
KHz with as many as 128x128 discrete subaperture samples. 
[0034] The aircraft canopy transmitted wavefront error is a 
function of azimuth and elevation angle. Thus, the bandwidth of 

15 canopy wavefront error measurement is proportional to the speed 

the mapping fixture scans the required field of regard. Very 
high-speed wavefront sensors allow canopy wavefront errors to be 
measured at very high sampling rates. This is in great contrast 
to current slower step/stare image acquisition as is done in 

20 current mappers. The entire wavefront error at each azimuth and 

elevation angle over the entire pilot eye volume (PEV) is 
measured as a single image. This eliminates the need to repeat 
the azimuth/elevation script for different eye positions. 
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[0035] In one embodiment, light from a collimator is aimed 
through the canopy and at the center of the PEV at a scripted 
azimuth and elevation angle. This collimator may be located 
inside or external to the canopy. The collimated light passes 
through a mask to produce multiple subapertures . Each 
subaperture then emits collimated light that passes through the 
canopy at the PEV. Imaging optics collect the patterned 
collimated light to create an image. The imaging optics are 
positioned external or internal to the canopy, where the 
collimator is located on the opposite side of the canopy. The 
imaging optics have sufficient aperture to intercept the deviated 
rays of collimated light from each subaperture. 
[0036] The resulting imagery is processed with a processing 
unit. The processing unit may be a single processing device or a 
plurality of processing devices. Such a processing device may be 
a microprocessor, micro-controller, digital signal processor, 
microcomputer, central processing unit, field programmable gate 
array, programmable logic device, state machine, logic circuitry, 
analog circuitry, digital circuitry, and/or any device that 
manipulates signals (analog and/or digital) based on operational 
instructions. The memory 34 may be a single memory device or a 
plurality of memory devices. Such a memory device may be a read- 
only memory, random access memory, volatile memory, non-volatile 
memory, static memory, dynamic memory, flash memory, cache 
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memory, and/or any device that stores digital information. Note 
that when the processing unit implements one or more of its 
functions via a state machine, analog circuitry, digital 
circuitry, and/or logic circuitry, the memory storing the 
5 corresponding operational instructions may be embedded within, or 

external to, the circuitry comprising the state machine, analog 
circuitry, digital circuitry, and/or logic circuitry. The memory 
stores, and the processing unit executes, operational 
instructions corresponding to at least some of the steps and/or 

10 functions illustrated in Figures 12, 13, and 14. 

[0037] The resulting imagery is processed using data reduction 
and error reconstruction algorithms embedded within software. 
These result in a highly sampled and very accurate representation 
and reconstruction of the wavefront error at the scripted azimuth 

15 and elevation. 

[0038] One application senses the location of the pilot's head 
within the canopy and supplies this information to wavefront 
reconstructor software that dynamically calculates the wavefront 
error at that azimuth and elevation, at any continuous point or 
20 pair of points in the 3-D PEV. 

[0039] Dynamic reconstruction of the canopy wavefront error as 
a function of head position enables dynamic positioning of the 
symbology on the HMD. This greatly improves visual cueing and 
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designation accuracy. Furthermore, this allows the HMD system to 
provide improved accuracy and performance. 

[00401 FIGURES lA and IB illustrate the optical effects the 
canopy has on an incoming wave front. The effects of the 
5 arrangements of FIGURE lA and IB are shown in FIGURES 2A and 2B, 

respectively. In FIGURE lA, a collimator supplies a collimated 
beam of light that is masked or patterned into subapertures to 
produce incoming wavefront 12. Incoming wavefront 12 is operated 
on by lenslet array 14. No canopy is present in FIGURE lA, thus 
10 incoming wavefront 12 is undistorted when received at lenslet 

array 14 and imaged using a CCD detector 16 or other like device. 
This undistorted image is shown in FIGURE 2A. 

[0043] In FIGURE IB, the collimator provides a collimated beam 
of light, which is patterned or masked into subapertures to 

15 produce incoming wavefront 12, which is optically distorted by 
canopy 18. Canopy 18 distorts wavefront 12 to produce an 
aberrated wavefront 20. When aberrated wavefront 20 is imaged on 
CCD detector 16 with lenslet array 14, a distorted image results. 
One can observe that the subaperture focal spots 21 are not 

20 evenly spaced on detector array 16. As shown, the subaperture 

focal spots 21 have shifted in two dimensions by (Ax, Ay). This is 
in contrast to the uniform distribution of subaperture focal 
spots 21 illustrated in FIGURE lA. This distorted image is 
illustrated in FIGURE 2B. 
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[0045] In this example, masking or patterning the collimated 
light with subapertures provides an undistorted Hartmann spot 
set. However, other like patterns or masks known to those 
skilled in the art may be employed. FIGURE 2B shows the same 
5 Hartmann spot pattern distorted by the optical deviations caused 

by the canopy. Here, spots 26 are individually shifted in the x 
or y position from their undistorted positions. 

[0046] FIGURE 3 provides an optical model for a tilted cylinder 
canopy. In this model, collimator 30 provides an optical 

10 wavefront 32, which passes through canopy 34. Optical wavefront 
32 is refracted by the optical properties of canopy 34. Because 
canopy 34 is tilted, not all portions of wavefront 32 are acted 
on by the canopy at the same time. This results in further 
distortion of wavefront 32. The distorted wavefront 36 is imaged 

15 by pilot's eye 38 or other like imaging device located with the 
PEV. 

[0047] FIGURES 4A through 4E provide simulated Hartmann spots 
for a cylindrical canopy where the distortion of the individual 
points is clearly visible as one approaches closer to focus. In 
20 FIGURE 4A, which is far from focus, the individual points form 

nearly straight lines. However, in FIGURE 4E, which is much 
closer to focus, the distortion of the points is clearly 
observed. 
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[0048] In FIGURE 5, the embodiment of the present invention 
depicted involves projecting a collimated light, such as a laser 
beam or filtered white light source, through a Hartmann mask or 
other like mask. This is done to pattern the collimated light 
5 which then passes through a canopy onto a ground glass screen. 

The screen allows an image of the patterned collimated light to 
be further imaged by a camera. Here, the collimated light (laser 
41) passes through canopy 44 after being patterned by a Hartmann 
mask 42. Image 45 is captured from ground glass screen 46 with 

10 and without the optical distortions of canopy 44. Alternatively, 

one may compare the expected image from the Hartmann mask 42 with 
the image distorted by canopy 44 on ground glass screen 46. This 
allows one to analyze the changes in spot positions or pattern of 
the images. Optical deviations caused by the canopy can then be 

15 quickly and easily determined for a large area as opposed to 

taking a large number of individual samplings. Additionally, 
optical deviations may be measured for a singular angular 
position over a range of eye positions defined by the size of 
Hartmann mask 42. Camera 48 and ground glass screen 46 may be 

20 mounted on a longitudinal translation stage 50 that allows the 
image captured by camera 48 to be viewed from a variety of 
separations between camera 48 and ground glass screen 46, as well 
as the relative distance between ground glass screen 4 6 and 
canopy 44. 
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[0049] FIGURE 6 depicts a direct image approach. Here a 
contrasting optical pattern, such as a large array of spots 60, 
is directly imaged by camera 62 located within canopy 64 at a 
single eye position. The optical deviations are measured by 
5 comparing the spot positions in images captured by camera 62 with 

and without the presence of canopy 64. This method measures a 
single eye position but covers a range of azimuth angles 
depending on the size of spot array 60. For example, one 
embodiment may cover +/- 6° in elevation and azimuth. 

10 [0050] The target board used for spot array 60 may comprise an 

array of contrasting spots in a square grid. However, other 
contrasting patterns may be used. Additionally, this array may 
be located at a variety of distances from camera 62, with the 
canopy 64 up or down. By taking the spot images at two different 

15 target distances, as well as with and without the canopy, an 

interpolation algorithm generates a displacement map for each 
image pair. Such an apparent displacement map is shown in FIGURE 
7 for the farther target distance. The displacement maps may be 
analyzed to resolve the wave displacement at the canopy and the 

20 angular deviation of the canopy. 

[0051] In FIGURE 8A, collimated light is projected from inside 
canopy 72 onto screen 74 located outside canopy 72. A pattern 
contained within the collimated lights 72 is imaged and recorded 
with screen 74. Collimated light source 78 projects collimated 

20 
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light 80 through a Hartmann mask 84 or other optical mask as 
known to those skilled in the art. The collimated light is then 
imaged and recorded by camera 88. The distance between screen 74 
and canopy 72 may be varied to help determine the optical 
5 distortion caused by canopy 72. Images 86 are taken with the 

canopy up and down, allowing the angular deviations caused by the 
linear distance between screen 74 and canopy 72 to be determined 
at each position, with and without the canopy. 

[0052] In FIGURE 8B, collimated light is projected from inside 
10 canopy 72 onto two ground glass screens 74A and 74B located 

outside canopy 72. A pattern contained within the collimated 
light 80 is imaged and recorded with screen 7 4A and 74B. 
Collimated light source 78 projects collimated light 80 which is 
reflected by a pair of reflective surfaces 75, that pivot about 
15 point 77, through a Hartmann mask 84 or other optical mask as 

known to those skilled in the art. By pivoting about point 77, 
the light may be directed at various angles through Hartmann mask 
84. The light passes through and is divided by beamsplitter 79. 
This allows light 80 to be imaged on ground glass screen 74A and 
20 74B at different distances di and d2 from canopy 72. Cameras 88A 

and 88B record images 86A and 86B from ground glass screen 74A 
and 74B respectively. Images 86A and 86B, being located at 
different distances from canopy 72 are used to establish a three- 
dimensional vector field. This is further illustrated in FIGURE 
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8C. Images 86A and 86B are taken with the canopy up and down, 
allowing the angular deviations caused by the linear distance 
between screens 74A and 74B, and canopy 72 to be determined at 
each position, with and without the canopy. 

[0053] FIGURE 8C shows that a ray of light 80 exiting canopy 72 
has direction cosines (K, L, M) • These are defined as K = 

(x. -X,) (y. -y.) Az 

^lJ_LZ ^ L = Hl-^ , and M = — , where d = 
ad d 

7[(X2 -Xj)^ +(y2 -Yi)^ +(Az)^ . The elevation angular deviation ''El" is 
the arcsine of direction cosine L, then the azimuth angular 

deviation is the arcsine of . Processor 81 of FIGURE 8B 

cos(El) 

operates on images 86A and 86B to define the sub-aperture 
centroids. 

[0054] FIGURE 9A depict a perfect wave front 90 with the canopy 
up and a zero degree elevation, which may then be compared to the 
distorted wavefront 92 of FIGURE 9B with the canopy down. 
Undistorted Hartmann pattern 94 caused by the mask is shown with 
no distortion from the canopy in FIGURE 2A and then compared to 
the distorted Hartmann image 96 of FIGURE 2B. 

[0055] FIGURE 10 depicts one embodiment used to measure the 
optical deviations of the canopy from varying elevations and 
azimuth angles relative to the PEV. In this arrangement, a light 
source produces light to be collimated by collimator 100. 
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Collimator 100 directs light 102 through Hartmann mask 104 or 
other like optical mask to produce patterned image 106 at pilot's 
eye centroid 108. Optical mask 104 and collimator 100 are 
translated in elevation angle relative to the pilot's eye 
5 centroid 108 along arc 110. Additionally, canopy 112 may be 

rotated in azimuth, relative to arc 110 in order to allow data to 
be collected on the optical distortions caused by the canopy 112 
from various combinations of elevation and azimuth angles. 
[0056) FIGURE 11 depicts a second embodiment wherein collimator 
10 100 is translated along stage 114 at varying distances and 

elevation angles from the pilot's eye centroid 108. Again, 
canopy 112 is mounted on a rotation table 116 to allow varying 
combinations of elevation and azimuth angle to be captured by 
imaging camera. 

15 [0057] FIGURE 12 is a logic flow diagram that describes one 

method of determining optical deviations caused by aircraft 
canopy. In Step 150 a beam of collimated light is generated 
outside the aircraft canopy. In Step 152, the collimated beam of 
light passes through an optical mask to produce a patterned 

20 collimated beam of light. The patterned collimated beam of light 

is directed to the pilot's eye centroid within the canopy in step 
154. A screen or other imaging device captures an image of the 
patterned collimated beam of light in step 156. At step 158, an 
undistorted image is captured and stored in memory. At step 160, 
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the aircraft canopy, placed in the path of the pattern collimated 
beam of light, distorts the patterned collimated beam of light to 
produce a distorted image, which is captured and stored in 
memory. The distorted and undistorted images stored in memory 
5 are compared to determine the optical distortions associated with 

the aircraft canopy. 

[0058] FIGURE 13 is a logic flow diagram that describes another 
method of determining optical deviations caused by aircraft 
canopy. This process is similar to that discussed in FIGURE 12. 

10 However, in this instance the beam of collimated light is 

generated inside the aircraft canopy at step 170. In Step 172, 
the collimated beam of light passes through an optical mask to 
produce a patterned collimated beam of light. The patterned 
collimated beam of light. is directed from the pilot's eye 

15 centroid within the canopy in step 174 to a screen or other 

imaging device outside the canopy. This allows the imaging 
device to capture an image of the patterned collimated beam of 
light in step 176. At step 178, an undistorted image is captured 
and stored in memory.. At step 180, the aircraft canopy, placed 

20 in the path of the pattern collimated beam of light, distorts the 

patterned collimated beam of light to produce a distorted image 
that is captured and stored in memory. The distorted and 
undistorted images stored in memory are compared to determine the 
optical distortions associated with the aircraft canopy. 
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[0059] With the optical distortions known, a processor coupled 
to a helmet-mounted display (HMD) can dynamically generate visual 
queuing and symbology aligned to images received from outside the 
aircraft canopy. This ability greatly improves the effectiveness 
5 of the HMD and allows information to be provided to a pilot that 

accounts significant optical distortions of images received from 
outside the aircraft canopy. 

[0060] FIGURE 14 is a logic flow diagram of another embodiment 
that determines optical deviations caused by an aircraft canopy. 

10 In Step 190 a contrasting optical pattern is located external to 

the aircraft canopy. In Step 192, an undistorted image of the 
contrasting optical pattern is recorded with a camera located 
within the pilot's eye centroid. This undistorted image is 
stored in memory for future processing. In Step 194 the aircraft 

15 canopy is placed between the pilot's eye centroid and the 

contrasting optical pattern. This allows the distorted image of 
the contrasting optical pattern to be recorded with the camera 
and again stored for future processing in Step 196. These 
distorted images are compared to undistorted images to generate 

20 optical deviation maps associated with the aircraft canopy as 

well as determine other optical distortions caused by the 
aircraft canopy. A camera records the contrasting optical 
pattern, which may comprise a simple white background with a grid 
of contrasting spots. The size and height of the contrasting 
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optical pattern determined the range in elevation and azimuth 
angles measured by the distorted and undistorted images relative 
to the pilot's eye centroid. Additionally, the distance between 
the aircraft canopy and the contrasting optical pattern may be 
5 varied between a first and second distance to produce a pair of 

distorted images and a pair of undistorted images. This pair of 
distorted and undistorted images allows an image displacement map 
to be made from the comparison of the distorted images to the 
undistorted images. 
10 [0061] The present invention gives faster and more accurate 

optical deviation measurements for automobile, bus, train and 
truck windshields as well. 

[0062] As one of average skill in the art will appreciate, the 
term ''substantially'' or ''approximately", as may be used herein, 

15 provides an industry-accepted tolerance to its corresponding 

term. Such an industry-accepted tolerance ranges from less than 
one percent to twenty percent and corresponds to, but is not 
limited to, component values, integrated circuit process 
variations, temperature variations, rise and fall times, and/or 

20 thermal noise. As one of average skill in the art will further 

appreciate, the term "operably coupled", as may be used herein, 
includes direct coupling and indirect coupling via another 
component, element, circuit, or module where, for indirect 
coupling, the intervening component, element, circuit, or module 



26 



ATTORNEY DOCKET NO. 
1017.P073US 



PATENT APPLICATION 



does not modify the information of a signal but may adjust its 
current level, voltage level, and/or power level. As one of 
average skill in the art will also appreciate, inferred coupling 
(i.e., where one element is coupled to another element by 
5 inference) includes direct and indirect coupling between two 

elements in the same manner as ''operably coupled". As one of 
average skill in the art will further appreciate, the term 
''compares favorably", as may be used herein, indicates that a 
comparison between two or more elements, items, signals, etc., 

10 provides a desired relationship. For example, when the desired 

relationship is that signal 1 has a greater magnitude than signal 
2, a favorable comparison may be achieved when the magnitude of 
signal 1 is greater than that of signal 2 or when the magnitude 
of signal 2 is less than that of signal 1. 

15 [0063] Although the present invention is described in detail, 

it should be understood that various changes, substitutions and 
alterations can be made hereto without departing from the spirit 
and scope of the invention as described by the appended claims. 
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